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Abstract 

We show that the exphcit formula of Stanley-Feray-Sniady for the characters of the symmetric 
group have a natural extension to the generalized characters. These are the spherical functions of 
the unbalanced Gel'fand pair {Sn x 5„_i, diagS'^-O.El 

1 Introduction 

Recently, two different explicit formulas have been found for the characters of the symmetric group, the 
Stanley-Feray formula, conjectured by R. P. Stanley [TU] and proved by V. Feray [S], and the formula of 
M. Lassalle [8 (se [S' for an account). Actually, these are formulas for spherical functions rather than 
characters. Indeed, these formulas give the normalized characters obtained by dividing each of them by 
the dimension of the corresponding representation. These are the spherical functions of the Gel'fand 
pair {Sn X S'„,diag5„), where diag5'„ = {(tTjTt) : tt £ Sn}. In [TT] E. Strahov showed that some of the 
classical results for the characters of the symmetric group may be extended to the spherical functions 
of the unbalanced Gel'fand pair (5„ x S*,!-!, diagS'„_i), where diagS'„_i = {(tt, vr) : vr G Sn-i}- This 
amounts to consider the algebra of all 5„_i-conjugacy invariant functions on Sn rather than the Sn- 
conjugacy invariant functions. It is a natural problem to extend a result for the normalized characters to 
the generalized characters of the symmetric group. In the present paper we show that the Stanley-Feray 
formula, in the form proved by Feray and P. Sniady in [5' , may be naturally extended to the generalized 
characters. 

2 Preliminaries 



We recall some basic facts on unbalanced Gel'fand pairs. We refer to [3J [3J [TTl [T^] for more details and 
proofs (but we follows the notation in our joint monographs with T. Ceccherini-Silberstein and F. ToUi). 
If X is a finite set, we denote by L{X) the space of all complex valued functions defined on X. Let G be 
a finite group. We say that iJ < G is a multiplicity free subgroup of G when Res^a is a multiplicity free 
representation of H for every irreducible representation tr of G. We recall that the action oi G x H on 
G = is {g, h) ■ go = ggoh~^. The subgroup H is multiplicity free if and only if (G x H, diagiJ) is a 

Gel'fand pair, if and only if the algebra of _ff-conjugacy invariant functions on G is commutative. Let G 
(resp. H) be a complete set of pairwise inequivalent (unitary) irreducible representation of G (resp. H). 
For CT G G we denote by a' the adjoint of cr. If p e and cr S G, we write p < Res^cr to denote that p 
is contained in Res^ cr; p denotes the tensor product of a and p; ^ and x'' are the characters of a 
and p (they are not normalized: X^^g) is equal to the dimension dp of p). If H is multiplicity free, the 
decomposition of permutation representation 77 of G x iJ on £(G) is the following: 
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'/ = i<^^p)- (1) 

ctSG peH: 

In particular, iox H = G the G x G-irreducible representation a M a' coincides with the cr-isotypic 
component in L{G), that is the subspace of L{G) spanned by the matrix coefficients of a. The spherical 
function associated to ct K p has the following expression: 



H 

' ' heH 

Following we call (j3a,p a generalized character of G. 

Proposition 2.1. Suppose that H is a multiplicity free subgroup ofG. With the notation above we have: 

1. ^,^p{h) = i-X^h) for all h e H; 

2. if e L{G) is H-conjugacy invariant, it belongs to the a-isotypic component of L{G) and ^p{h) = 
-^X''{h) for all h e H then ^ — (f)a.p- 

Proof. Suppose that Res^cr' = ®™ i Pi^ with pi, p2, ■ ■ ■ , Pm G H (pairwise inequivalent) and pi = p. 
1. For every heH we have: 



' ' teH ' ' L \i=l 



*X' 



dp 



2. Since ip is i?-conjugacy invariant and belongs to the cr-isotypic component of L(G) then -tp 
Ci4>a,pi, for suitable complex constants ci, C2, . . . , Cm- Therefore 



-J m m 

^P - 1 1 ^Pi 

implies that q — (5j^i, that is ^ = 0o-.p- 



□ 



3 Brender's formula 

In this section we give a short proof of the main result in [T] . It is a formula for the generalized character 
of the symmetric group analogous to (8) in [5]. Let Sn be the symmetric group of degree n. We think 
of it as the group of all permutations of the set {1, 2, . . . , n}. We denote by S'„_i the stabilizer of 1 in 
Sn- Then (TJ [3J [31 [H] Sn-i is a multiplicity free subgroup of If A h n then 5'^ is the corresponding 
irreducible iSn-representation. We identify A h ti with its Young frame; if A h n and p \~ n — 1 we write 
A — > /i to denote that p may obtained from A by removing one box (we denote hy X \ p this box) ; note 
that Strahov draws the arrow in the opposite sense. Then the branching rule for the symmetric group 
may be written in the form: Res|"_ 5'*' = ®/ii-n-i: S"^. Therefore, in the present setting, ([T]) is: 

A— >p 

^(^") = {S'^S'^). 

Ahn /^hn — 1: 
A— y/j 
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We denote by (f)\,^ the generalized character associated to S^M . 

We win use the foUowing notation: a function / e L(Sn) will be identified with the formal sum 
J^ttgS fi'^)'^- If ^ is a A-tableau (an injective filling of the Young frame of A with the numbers 
{1,2, ... ,n.}), we denote by Rt (resp. Ct) the row (resp. the column) stabilizer of t. It is well known 
that the element 

Et^ ^ ^ sign(7)7cr, 

belongs to the A-isotypic component of L{Sn) [TIIH]: it is a multiple of an idempotcnt that projects onto 
a minimal left ideal of L{Sn) isomorphic to S*^ (see also Exercise 10.6.7 in ;2, for a less standard proof). 
Denote by the character of S''^ and by d\ the dimension of Sn- We have: 

The proof is immediate: / i — > ^ X^ttgs ^/^^^ is the orthogonal projection from L{Sn) onto the subal- 
gebra of S'„-conjugacy invariant functions and the value of Et on Is^ is 1. See again Exercise 10.6.7 in 
[2] or (VI.6.1) in 9 (where jp must be replaced by ^) or (8) in [6]. 

Proposition 3.1. // // A h n, h n — 1, A — /i and t is a X-tableau with 1 in the box A \ then: 

'^A.M= E TTEtTT^K (3) 

Proof. The right hand side of ([3]) is S'„_i-conjugacy invariant and belongs to the S''''-isotypic component 
of L{Sn)- Moreover, following Travis we may write Et = Ef + where t' is the /x-tableau obtained 
removing the box containing 1 and 

^ = E sign(7)7cr. 

but 7^S„_i or (T^S„-i 

Both ^ and (^^-ly. "^nes i ""C""^^ do not contain elements of Sn-i'- if 7 G Ct, a & Rt but 7 ^ Sn-i or 
CT ^ Sn-i then 7CT ^ 5'„_i. Therefore from ([2|) applied to S'„_i we get: 

Now invoking 2. in Proposition 12 . 1 1 we get the desired result. □ 

4 The Stanley-Feray-Sniady formula for the generaUzed char- 
acters 

Let A, n and t be as in Proposition 13. II For j,a € Sn we set: 

j\j-\,fj. _ ^YiQ number of tt G Sn~i such that: each cycle of 7 is contained in a column of irt and 
each cycle of ct is contained in a row of ttL 

As in [6], if □ is a box of A we denote by r{D) and c{D) respectively the row and the column to which □ 
belongs. Note also that in our notation, Sn^i is the stabilizer of n; more generally. Si < Sn, 1 < I < n, is 
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the symmetric group on {1,2,..., 1} and we will need to consider elements tt in Si but not in S'„_i, that 
is permutations of {1,2, ... ,1} that do not fix 1. Indeed, 1. in Proposition 12.11 tells us that the value of 
a generalized character (px^^ on an element tt G Sn-i is given by the formula for the classical characters. 
For E Si, with 2 < I < n, we set 

^s'l^ili f ) = the number of one-to-one maps / : {1,2, ... ,1} — > A such that: /(I) = A \ /i, 
c o / is constant on each cycle of 7 and r o / is constant on each cycle of cr, 

and (removing the injectivity) 

iV^'^(7, cr) = the number of functions / : {1, 2, . . . , /} — > A such that: /(I) = A \ ^, 

c o / is constant on each cycle of 7 and r o / is constant on each cycle of a. 

Note that if 7, ct G Si then 

N'^^^{j,a) = {n~iy.N^';ij,a). (4) 

Indeed, when we compute N'^''^{'y, cr) we need to determine the positions of 1, 2, . . . , / in irt, while the 
positions oi I + 1,1 + 2, . . . ,n may be choosen arbitrarily. We recall that {x)k — x{x — 1) • • • (x — / + 1). 

Lemma 4.1. If 9 ^ Si then 

MO)^ , \ E sign(7)7V^'^(7,a). 

■ya—O 



Proof. We may rewrite ([3)) in the form 

jji-i) 



^.M = [ sign(7)7<^- 



Since 



7 G C^t <J=4> each cycle of 7 is contained in a column of irt 
a e i?7rt *S=^ each cycle of cr is contained in a row of nt 

we deduce that 

M0)^r^^ E sign(7)7V^^''(7,a) 

Suppose that = i, <t{i) = j and 7(j) = i, with i ^ j. If i, j are contained in a row of irt thay cannot 
be contained in a column of irt and viceversa. Therefore if iV^'^(7,cr) 7^ and 7cr = then supp(7), 
supp(cr) C supp(6'). In particular, if 6* G Si, the sum may be restricted to 7, cr G Si; keeping into account 
Q we get 

0a,m(^)- E sign(7)^s;''(7,'^)- 

7(7 — 

One can end the proof using the identity 
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J2 sign(7)iV^;^(7,a)= ^ sign(7)iV^'^(7, a), 

f.creSi: 1,aeSi: 
■ya—9 ^(7—9 

which has the same proof of (10) in [B]. 

□ 

We denote by C{tt) the set of cycles of a permutation tt. A coloring of the cycles of 7, tr is a function 
h : C(7) U C{a) — > N. We set: 



N^''^{'j, a) — the number of colorings h of the cycles of 7 and a such that: 

— the color of each cycle of 7 is a column of A; 

— the color of each cycle of cr is a row of A; 

— the color of the cycle of 7 containing 1 is c(A \ /i); 

— the color of the cycle of a containing 1 is r(A \ /i); 

— if ci G C(7), C2 e C(o-) and ci H C2 ^ then (/).(ci), /i(c2)) 
are the coordinates of a box in A. 

Now we can enunciate and prove the analogous of Theorem 2 in 6J for the generalized characters. 
Theorem 4.2. If 9 e Si then 

<l^xAO)^ . _\. E sign(7)7V^'^(7,a). 

'y.ueSi: 

^(7 — 9 

Proof. It follows from Lemma [4.11 and the identity: N^'^{j,a) = N^'^{j,a). This may be proved by 
means of the following natural bisection h 1 — > f between the colorings h counted by iV'^'^(7,(T) and the 
functions / counted by N^''^{'-f, a): 

f{m) — {h{ci) , h{c2)) if ci £ C{'j), C2 G C(ct) and m e cif) 02- 

□ 

Example 4.3. Suppose that r(A \ fi) = i and c(A \ ^) = j. If A = (Ai, A2, . . . , Afc) and the conjugate 
partition is A' = (A^, Aj, . . . , A'^) then j — Xi and i ^ X'j. Moreover, 



7V^-'^((1)(2),(12)) = A. and 7V^''^((12), (1)(2)) = A^-. 

A. - A' 



0A,4(12)) = 

?i — 1 

This formula, in a slightly different form and by means of a completely different method, was found by 
P. Diaconis in g], (5.10). 
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